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Abstract We model the evolution of two populations C/,,V, in competition by a 
two-dimensional size-dependent branching process. The population characteristics 
are assumed to be close to each other, as in a resident-mutant situation. Given that 
Ut = in and V, = n the expected values of and Vi+i are given by me''^'^^"'^''"^ 
and ne''^^^"^"'"\ respectively, where r, r model the intrinsic population growth, K 
model the force of inhibition on the population growth by the present population 
(such as scarcity of food), and a,b model the interaction between the two popula- 
tions. For small K,K the process typically follows the corresponding deterministic 
Ricker competition model closely, for a very long time. Under some conditions, 
notably a mutual invasibility condition, the deterministic model has a coexistence 
fixed point in the open first quadrant. The asymptotic behaviour is studied through 
the quasi-stationary distribution of the process. We initiate a study of those distribu- 
tions as the inhibitive force K,K approach 0. 



1 Introduction 

A general competition model between k different species put forward in fTT] is 

XUi^MXr,^r)X;, l,2,---k, f-0,1,... (1) 

where the state space S is a closed subset of and the coordinate axes form the 
extinction set So; the ^'s represent a randomly evolving environment. 

Since we concentrate on the two-dimensional case. A: = 2, it will be more conve- 
nient to call the components X and Y, respectively. For a corresponding determinis- 
tic system we will use lower case x and y instead. 
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There are many different / (growth factor of the /th species) proposed in the 
literature, e. g., the Leslie-Gower competition model (a generalized Beverton-Holt 
model) which in its deterministic form may be written 

1 

Xt+l = b\ — ; Xt 

1 +x, + ciyt 

yt+\ ^^2— — ^— — y,. 
1 +C2A7 +yt 



see |I3]. Here we consider a Ricker-type function, first in a deterministic form 

Jt+l =yti 



X,+ i =x,e 



where a and b are taken close to 1, when the populations have largely the same 
characteristics, as in a resident-mutant situation. 

In the terminology of (1), with the randomness suppressed, we have here /i {x,y) — 
^r-x-hy ^jjjj f^ix^y) = gf-'^-v. Denote 

F{x,y) = (x/i {x,y),yf2{x,y)) = (xe^'^-'^y ,y/-"^-y) (2) 

A very thorough study of the stability properties of this map F, the Richer competi- 
tion model RCM, is provided by ||9l, see also H], ID. 

The one-dimensional Ricker model, introduced in ifTOl 

JCr+l ^JCfg''"'^-", r =0,1,2,... 

models the evolution of the population density of a species. 

• Xt is the density at time t or in the fth generation, 

• r (or e') is the birth rate, rate of natural increase, 

• K models the strength of an inhibitive factor, e. g., from internal competition for 
scarce resources (in Ricker's original paper derived from predation of the adult 
upon the young), 

• the origin and the point are the fixed points of the system. 

A key fact is: If r and xq are positive, the arithmetic averages of Xt of the one- 
dimensional Ricker model always approach ^. 

We note that if we pass to the normed process Kxt (Kx being the new x) we can 
simplify the one-dimensional Ricker equation to 

Xt+i = xte''^''' . (3) 
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2 Demographic stochasticity 



In this section we introduce a two-dimensional competition model which is essen- 
tially the RCM as in the Introduction combined with demographic stochasticity. 

Let q and q be two offspring distributions with means e'' and e' , respectively. We 
also assume that the have finite variances a' and a'. Let and be two competing 
populations (modeled as branching processes) of the form 

u, 

f/»+i = E^^V' f = 0,1,2,... (4) 

7=1 
V, 

= E^7V f = 0,1,2,.... (5) 

;=i 

If [/, = (V, = 0) then we define U,+ i=Q {V,+ i = 0). In the definitions above the ^ 's 
and ^ 's are independent nonnegative random variables with distributions depending 
on the ?th generation values: 

P{^ij=k I U, ^m,V, =n} =exp{-K{m + bn))qk, ^=1,2,3,... 
P{^it^k I Ut = m.Vt = n} = exp{—K{am + n))qi;, A:= 1,2,3,... 

when m or n are positive integers, a models the relative influence of individuals of 
the t/-species on the size of the litters ^ of the V-species, and vice versa for b. 

The corresponding conditional probabihty of =0 is given by the expression 
l-exp{^K{tn + bn)){l-qo) (6) 

and similarly for £,i f 

{U,,Vt) is a Markov chain on the nonnegative quadrant of Z^. In principle, all 
values are attainable in one step from any interior point. Thus the interior of Z\ 
constitutes one communicating aperiodic irreducible class. 

The conditional means of the normed processes KUt+i and KVt+\ given KUt ~ 
x.KVt =y are 

K K 

xe\p{r-x-b-^y), ye\p{r - a—x~ y) (7) 
K A 



showing close analogy with the deterministic cases (1213b . - Let us modify our defi- 
nition of F in (|2l) slightly, replacing a by and bhy bj: 

K K 

F{x,y) = {xexp{r-x-b-^y),ye\p{r-a—x-y)) (8) 

A A 
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The conditional variance of KUf+\ is 

Kxsx^{-x-b^y){a^ + e^''{\-e-''-^J^)} (9) 
K 

with a similar formula for KVt+i- 

Let us call the normed process (X,,y,); Xt ~ KUt, Yt = KVf. This is the two- 
dimensional stochastic Ricker competition model to be investigated in this paper 

For small values of K and K the {Xt,Yt) chain follows the path of the determin- 
istic process with very high probability: The formula (|9) shows that the standard 
deviations are of the order of \/K, Thus the process, whose both components 
are sums of independent random variables, is approximately normal with small stan- 
dard deviation. More concretely, suppose we start the normed process at {x,y), then 
the next step is approximately normal with mean given by d?) and a standard de- 
viation which can be made very small. As shown in |I8] [5] we can infer the same 
thing for a finite number of steps, {X,,Yt) « F'{Xo,Yo) for f = l,2,...k, when K,K 
are small enough. The difference is a sum of independent random variables and 
approximately bi-variate normal. 

We see from (|6]l that the extinction probability of the X-process in one step given 
Xt = x,Y, = y is of the form 

iil-exp{-x-b^y){l-qo))i >5^ (10) 

where the positive number 5 = 2^'°s2 is the minimum of the function (1 — e^"y. 

Since the K-component behaves similarly, we can infer that the extinction prob- 
ability of our bivariate stochastic process in one step is at least 

5^+^ (11) 

regardless of the present state of the process. Thus it has a finite life-time almost 
surely. 



3 Mutual invasibility 

The two-dimensional deterministic system F defined by ([8]) has fixed points at 
the origin (corresponding to the case when both species are extinct), at the point 
(r,0)(the y-component is extinct and the jc-component at its equilibrium), at (0,r) 
and possibly at 
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We will assume conditions which guarantee the existence of the fixed point in 
the open first quadrant, {x* ,y* ) is then called the coexistence fixed point. 

Suppose yo = f (seen, e. g., as the resident population density)) and jcq (the mutant 
population density) is very small. Then the first component xi of (xi = F(xo,yo) 
is larger than xq if the condition r>b^f\s met. The interpretation is that the mutant 
X can increase from small values while the resident population is at its equilibrium. 
We say that x can invade y. Conversely, y can invade x if f > a^r. 

We will impose two conditions: 

ab<l (13) 

and the mutual invasibility condition 

K K 

r>b—f, f>a — r. (14) 
K K 

It is immediately seen that this is sufficient to ensure the existence of a coexis- 
tence fixed point (x*,y*) in the open first quadrant. The fixed point may be repelling 
or attracting; the conditions can be found in ||9]- 

Remark. If the population characteristics are very close to each other one could 
well choose a = = 1 . In lH we investigated such a case: there is no coexistence 
fixed point so one of the two populations will eventually take over completely. 

Without regard to the attractivity properties of the fixed points, the conditions 
( 113114b guarantee the existence of an invariant compact set C inside the open first 
quadrant: F{C) C C. For the detailed calculations, see |6]. 

In 161 it is also proved that there exists a compact set C\ such that it is mapped 
"far inside" C\ by some iterate of F . To be more precise, there is a compact 
set C\ inside the open first quadrant such that the Euclidean distance between the 
outside of C\ and F'^{C\ ) is strictly positive: 

d{C'i,F''{Cy))>Q. (15) 

Another way of putting it is to say that F^ {C\) is farther away from the coordinate 
axes than C\ . 



4 The quasi-stationary distribution 

The analysis of the process [Ut.Vt) and its normed version follows the out- 

line in ||5]. 

The Markov chain (C/; , V, ) in the interior of the first quadrant was found above 
to have a finite lifetime a.s., see ( fTTT i. For any (m,n), both components positive, the 
probability of moving straight to the origin is the product of expressions such as (|6]i: 

(1 -exp(-/:(m + /7«))(l -^o))'"(l -exp(-^(flm + «))(l -§()))" 
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which can be minorized by an expression of the form 

(1 -exp(-L(m + «))(! -^o))'"+" « 1 - (m + «)exp(-L(m + «))(! -^o) (16) 

where L is taken such that L{m + n) < imn{K{m + bn),K{am + n)) and qo = 
max(q'o,^o)- 

Following the corresponding proof in ||5] we can now draw the conclusion that 
the entries of the transition probability matrix Q of the Markov chain restricted to the 
strictly positive states (m, n) have a finite sum. The sub-markovian transition matrix 
has a spectral radius (the Krein-Rutman maximal eigenvalue X) bounded above by 
an expression of the form 

1 -5^+^ 

where 8 again is the strictly positive minimum of the function (1 — e^^y. This is a 
rough upper bound because the complement of the all-positive states is the union of 
the non-negative coordinate axes, and not just the origin (0,0). 

The Markov chain restricted to the strictly positive states admits a quasi-stationary 
distribution (qsd) n. One of the characterizations of the qsd is that it is the left eigen- 
vector corresponding to the dominant eigenvalue A : 

Xtz = TZQ. 

Another is the following invariance property: If the initial distribution is n then the 
conditional distribution of the first step given that it is all-positive is n, too: 

P;r{([/l,Vl) = (•,•) I C/l >0,yi >0} = 7r(v) 

where we use the notation Pjc to indicate that the initial distribution (the distribution 

of (f/cVo)) is n. 



5 Asymptotics 

Our asymptotic analysis follows the reasoning in ||5] closely. The quasi-stationary 
distribution n depends on K and K. (We assume a and b to be constant.) As K and 
^ go to the family of probabihty measures % ^ is tight provided K and K vary 
boundedly in such a way that the fixed point {x* ,y*) in (fT2] i stays in a compact set 
within the interior of the first quadrant. For simplicity we take K ^ K, Q < K < 1, 
from now on. 

Theorem 1. Let K = K. Let | |73I74I ) be satisfied. Consider the Markov chains {X, , Yt ) 
for K > and their quasi-stationary distributions TZk- The family of probability 
measures TtK, K > 0, is tight. 

Proof. Recall that the conditional mean of i ) given that {Xt,Yt) = {x,y) is 

F(x,y) = {xfi {x,y),yf2{x,y)), (|2|i, and the variance of its first component is 
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Kxexp{^x-by){a^ + e^''{l-e-'-''y)} (17) 

with a similar formula for the second component, see (|9). 

Following Is], Section 3, let S{s) be the moment generating function (mgf) of the 
offspring distribution q and C(^^y){s) the mgf of the variables of dU given that 
X{t) —X and Y{t) =y. The entropy function cl'^. (z) of is sup^gg^[zi — C(;f 
As in 15], PP- 252-253, we get, for any positive a, 

Q. X X 

P{X,+i >fl+x/i(x,y) I X,=x,y,=y}<exp(-i(---/i(x,y)) + -C(,,j,)(i)) 
which is at most 

The entropy function is at the conditional mean e''^^^^>' of B,jj and at least 3^7 (f)^ 
for small a. 

Since the variance varies continuously with x and y we can conclude that the 
exponent can be bounded away from when {x,y) lies in a compact set in the interior 
of the first quadrant. 

Thus, given a small positive a, there exists a w > such that 

w 

V{X,+ ,>xf,{x,y)+a I X,-x,y,=3;}<exp(--) (18) 

K 

(and similarly for for all {x^y) in a given compact set in the open first quadrant. 
Putting it in another way, we have 

w 

n%+uY,+x)^U{F{x,y)) I {X„Y,)^{x,y)}>l-txp{--) (19) 

where U{F{x,y)) is a neighbourhood of the point F{x,y). 

If we take as our compact set an invariant set C, such as the one constructed in 
||6l , and as U (C) an open set containing C we get 

w 

P{(X,+i,F,+i)ef/(C) I (X„};)eC}> l-exp(--). (20) 

A 

Since F is continuous we can extend the above relation, by appropriately adjust- 
ing the quantity w > 0, to the Mh iterate of F\ 

w 

¥{{Xt+N.Y,+N)(.U{C) I (X,,y,)eC}>l-exp(--). (21) 

A 

Now we let and C\ be as in ||6l, i. e., the interior of C\ is an open set containing 
F^{Ci). Then we obtain 

w 

WnM eCl I (Xo, Fo) e Ci } > 1 - exp(- -) (22) 

A 
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from which we can draw the conclusion, as in [5], that the dominant eigenvalue 
X = X{K) of the transition probability matrix of the Markov chain restricted 
to the positive quadrant of 5?^, differs "exponentially little" from 1 : 

l-exp(-|)<A(/:)<l (23) 

for some u > 0. 

Starting the Markov chain from the point {Xq,Yq) = {x,y) the distribution of 
{Xi,Yi) has mean F{x,y) and a uniformly bounded variance, see (fTTt . Hence there 
is a compact set B C such that the probability of {Xi , Yi ) being outside of B is 
< £ for all {x,y) and all K. As in i5| we conclude that 7rA:(B') < 2e. 

In a strip S close to the y-axis, the function ( 1 — e^^y approaches 1 , it is > e^'' for 
some small positive v. Take v so small that < \' < m where u satisfies ( l23T l above. 
The probability of immediate exit from the state space (the open first quadrant) is at 
least starting from a point in S. If the initial point is chosen according to law 
TtK then the exit probability is 1 — X{K) (by the definition of qsd). As in fSl we use 
$23i to conclude that 

MS) < exp( —) 

which can be made < e for K small enough. A similar reasoning can be applied to 
a strip above the jc-axis. 

The above remarks show that, for given positive e, there exists a compact set 
inside the open first quadrant whose ;rA-measure is > 1 — 4e for all K small enough. 

Thus the family tzk, A" > 0, is tight. 

Theorem 2. The limit measures of tzk as K ^ are invariant with respect to the 
deterministic system F. If the coexistence fixed point (x* ,y*) of ( 1721 ) is attracting 
then the quasi-stationary distributions converge to the point mass at the fixed point: 

lim Kk = 5u* y,y 

Proof. (Sketch) The invariance of the limit measures is proved as in Step 5 of fj), 
pp. 254f. We know, see [91 , that the coexistence fixed point {x* ,y*) is attracting if 
2{l-b)r + 2{l-a)r~4{l-ab) < {r-br){r-ar) < {I - b)r + {I - a)r. Also, 
by lEl, if this condition is satisfied it is globally attracting so that the point mass 
at (x*,y*) is the unique invariant measure for the deterministic system F inside the 
open first quadrant of 



6 Conclusion and outlook 

Theorems [T] and |2] show that the branching process {Ut,Vt) and its normed version 
{Xt,Y[), even if it eventually goes extinct, emulates the deterministic process for a 
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long time. The dominant eigenvalue is within e te" of 1 so the expected lifetime 

1 

of the process is exponential in When the coexistence fixed point {x* ,y*) is at- 
tracting we can say more: the quasi-stationary distribution is a "blurred version" of 
the point mass at (x*,^*). The linear autoregressive approximation of iXt.Yt) in the 
vicinity of the fixed point, which was introduced by ISJ in a similar one-dimensional 
case, can be used as in Q to obtain rough estimates of the quantity u in ( |23] ). This 
in turn gives us an estimate for the expected life-time. 

If the coexistence fixed point is repelling, the picture is less clear. We know by 
Theorem [T] that the qsd's do have limits but their precise nature is unknown. Sim- 
ulations suggests a conjecture for r, r not too large: the limits will be supported by 
the attracting cycles of the deterministic system F (as in the one-dimensional Ricker 
case, see [5]). A successful completion of this program is Ukely to require a thor- 
ough understanding of the two-dimensional dynamical system generated by F . 
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